
PATENT 
450100-02250 



IN THE CLAIMS: 

The following listing of the claims replaces and supersedes all prior claim listings: 

1. (Original) An image pickup method of synthesizing a plurality of images acquired by 
sensing an object under different exposure conditions to produce a single image excellent in 
graduation reproducibility, the method comprising the steps of: 

sensing an object under different exposure conditions to acquire a plurality of images; 

compensating the levels of plurality of images on the basis of the exposure conditions 
under which they have been sensed respectively, to provide a plurality of compensated images; 



synthesizing the plurality of compensated images to produce a single synthetic image 
having a wide dynamic range; and 

compressing the synthetic image to an extent depending upon the performance of its 
output destination to produce a compressed image. 

2. (Original) The method as set forth in Claim 1, further comprising the step of 
subtracting from the pixel level of each of the plurality of images a positive value given based on 
the exposure condition under which each of the images has been sensed to produce the 
compensated image. 

3. (Original) The method as set forth in Claim 2, further comprising the steps of: 
calculating a mean pixel value of each of the plurality of images; and 

P 

multiplying the mean pixel value obtained at the mean calculating step by a factor set 
based on the exposure condition to calculate a positive value. 
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4. (Original) The method as set forth in Claim 3, further comprising the steps of: 

time-smoothing the positive value obtained at the multiplying step; and 

subtracting the time-smoothed positive value from the pixel level of each of the plurality 



5. (Original) The method as set forth in Claim 3, wherein the factor is set larger for the 
image having been sensed with a larger exposure at the image sensing step. 

6. (Original) The method as set forth in Claim 2, further comprising the steps of: 
filtering the signal of each of the plurality of images by a predetermined low-pass filter; 

and 

multiplying an output obtained at the filtering step by a factor set based on the exposure 
condition under which the image has been sensed to calculate a positive value. 

7. (Original) The method as set forth in Claim 6, further comprising the steps of: 
time-smoothing the positive value obtained at the multiplying step; and 

subtracting, at the subtracting step, the positive value obtained at the time-smoothing step 
from the pixel level of each of the plurality of images. 

8. (Original) The method as set forth in Claim 6, wherein the factor is set larger for the 
image having been sensed with a larger exposure at the image sensing step. 



of images. 
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9. (Original) The method as set forth in Claim 1, wherein each of the plurality of 
images acquired at the image sensing step is an image signal in which a frequency-modulated 
color signal is superposed on a brightness signal, the method further comprising the step of 
separating the image signal into the brightness and color signals; and 

the brightness signal and color signal separated at the signal separating step being 
compensated at the level compensating step to produce a compensated brightness signal and a 
compensated color signal, respectively; 

the compensated brightness and color signals being synthesized at the image synthesizing 
step to produce a synthetic brightness signal and a synthetic color signal, respectively, and 

the synthetic brightness and color signals being compressed at the image compressing 
step to produce a compressed brightness signal and a compressed color signal, respectively. 

10. (Original) The method as set forth in Claim 9, wherein at the level compensating 

step: 

a compensation amount is calculated based on the brightness signal separated at the 
signal separating step: 

the level of the brightness signal is compensated with the compensation amount to 
produce a compensated brightness signal; and 

the compensated color signal is produced based on the compensated brightness signal. 

11. (Original) The method as set forth in Claim 9, further comprising the step of mixing 
the compressed brightness and color signals. 
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12. (Original) An image pickup method of synthesizing a plurality of images acquired by 
sensing an object under different exposure conditions to produce a single image excellent in 
graduation reproducibility, the method comprising the steps of: 

sensing an object under different exposure conditions to acquire a plurality of images; 

synthesizing the plurality ofcompensated-images to produce a single synthetic image 
-have a wide dynamic range; 

compressing the dynamic range of the synthetic image to an extent depending upon the 
performance of its output destination to produce a compressed image; and 

compensating the level of the compressed image to provide a compensated compressed 

image. 

13. (Original) The method as set forth in Claim 12, further comprising the step of 
subtracting a predetermined positive value from each pixel level of the compressed image to 
produce the compensated compressed image. 

14. (Original) The method as set forth in Claim 13, further comprising the steps of: 
filtering the signal of the compressed image by a predetermined low-pass filter; 
normalizing an output value obtained at the signal filtering step; and 

multiplying the output value obtained at the normalizing step by a predetermined factor 
to calculate a positive value. 

15. (Original) The method as set forth in Claim 14, further comprising the steps of: 
time-smoothing the positive value obtained at the multiplying step; and 



-5- 



00188942 



PATENT 
450100-02250 

subtracting, at the subtracting step, the time-smoothed positive value from each pixel of 
the compressed image. 

16. (Original) The method as set forth in Claim 12, wherein each of the plurality of 
images acquired at the image sensing step is an image signal in which a frequency-modulated 
■color signal is superposed on a brightness signal, the method further comprising the step of 
separating the image signal into the brightness and color signals; and 

the brightness signal and color signal separated at the signal separating step being 
synthesized respectively at the image synthesizing step to produce a synthetic brightness signal 
and a synthetic color signal, respectively; 

the synthetic brightness and color signals being compressed respectively at the image 
compressing step to produce a compressed brightness signal and a compressed color signal, 
respectively; and 

the compressed brightness and color signals being compensated at the level compensating 
step to produce a compensated compressed brightness signal and a compensated compressed 
color signal, respectively. 

17. (Currently Amended) The method as set forth in Claim 16, wherein at the level 
compensating step: 

a compensation amount is calculated based on the compressed brightness signal separated 
at the signal separating step; 

the level of compressed brightness signal is compensated with the compensation amount 
to produce a compensated compressed brightness signal; and 
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the compensated compressed color signal is produced based on the compensated 
comp e nsat e d compressed brightness signal. 

18. (Original) The method as set forth in Claim 16, further comprising the step of mixing 
the compensated compressed brightness and color signals. 

19. (Original) An image pickup apparatus adapted to produce a single image excellent in 
graduation reproducibility from a plurality of images acquired by sensing an object under 
different exposure conditions, the apparatus comprising: 

means for sensing an object under different exposure conditions to acquire a plurality of 
images; 

means for compensating the levels of the plurality images on the basis of the exposure 
conditions under which they have been sensed respectively, to provide a plurality of 
compensated images; 

means for synthesizing the plurality of compensated images to produce a single synthetic 
image having a wide dynamic range; and 

means for compressing the synthetic image to an extent depending upon the performance 
of its output destination to produce a compressed image. 

20. (Original) The apparatus as set forth in Claim 19, wherein the level compensating 
means comprises means for subtracting from the pixel level of each of the plurality of images a 
positive value given based on the exposure condition under which each of the images has been 
sensed to produce the compensated image. 
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21. (Original) The apparatus as set forth in Claim 20, wherein the level compensating 
means comprises: 

means for calculating a mean pixel value of each of the plurality of images; and 
means for multiplying the mean pixel value provided by the mean calculating means by a 
factor set based on the exposure condition to calculate a positive value. 

22. (Original) The apparatus as set forth in Claim 21, wherein the level compensating 
means comprises: 

mean for time-smoothing the positive value provided by multiplying means: and 
means for subtracting the time-smoothed positive value from the pixel level of each of 
the plurality of images. 

23. (Original) The method as set forth in Claim 21, wherein the factor is set larger for the 
image having been sensed with a larger exposure by the image sensing means. 

24. (Original) The apparatus as set forth in Claim 20, wherein the level compensating 
means comprises: 

means for allowing to pass the signal of each of the plurality of images through a 
predetermined low-pass filter; and 

means for multiplying an output of the signal filtering means by a factor set based on the 
exposure condition under which the image has been sensed to calculate a positive value. 
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25. (Original) The apparatus as set forth in Claim 24 5 wherein the level compensating 
means comprises means for time-smoothing the positive value provided by the multiplying 
means; 

the subtracting means subtracting the time-smoothed positive value from the pixel level 
of each of the plurality of images. 

26. (Original) The apparatus as set forth in Claim 24, wherein the factor is set larger for 
the image having been sensed with a larger exposure by the image sensing means. 

27. (Original) The apparatus as set forth in Claim 19, wherein the image sensing means 
is adapted to output an image in which a frequency-modulated color signal is superposed on a 
brightness signal, the apparatus further comprising means for separating the image signal into the 
brightness and color signals; and 

the level compensating means compensating the brightness signal and color signal 
separated by the signal separating means to produce a compensated brightness signal and a 
compensated color signal, respectively; 

the signal synthesizing means synthesizing the compensated brightness and color signals 
to produce a synthetic brightness signal and a synthetic color signal, respectively; and 

the image compressing means the synthetic brightness and color signals to produce a 
compressed brightness signal and a compressed color signal, respectively. 

28. (Original) The apparatus as set forth in Claim 27, wherein the level compensating 
means calculates a compensation amount based on the brightness signal separated by the signal 
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separating means, compensates the level of the brightness with the compensation amount to 
produce a compensated brightness signal, and produces the compensated color signal based on 
the compensated brightness signal. 

29. (Original) The method as set forth in Claim 27, further comprising means for mixing 
the compressed brightness and color signals. 

30. (Original) An image pickup apparatus adapted to synthesize a plurality of images 
acquired by sensing an object under different exposure conditions to produce a single image 
excellent in graduation reproducibility, the apparatus comprising: 

means for sensing an object under different exposure conditions to acquire a plurality of 
images; 

means for synthesizing the plurality of compensated images to produce a single synthetic 
image having a wide dynamic range; 

means for compressing the dynamic range of the synthetic image to an extent depending 
upon the performance of its output destination to produce a compressed image; and 

means for compensating the level of the compressed image to provide a compensated 
compressed image. 

3 1 . (Original) The apparatus as set forth in Claim 30, wherein the level compensating 
means comprises means for subtracting a predetermined positive value from each pixel level of 
the compressed image to produce the compensated compressed image. 
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32. (Currently Amended) The apparatus as set forth in Claim 31, wherein the level 
compensating means comprises: 

means for filtering the signal of the compressed image; 

means for normalizing an output value provided by the signal filtering means; and 
mans means for multiplying the output provided by the normalizing means by a 
predetermined factor to calculate a positive value. 

33. (Original) The apparatus as set forth in Claim 32, wherein the level compensating 
means comprises: 

means for time-smoothing the positive value provided by the multiplying means; and 
means for subtracting the time-smoothed positive value from each pixel level of the 
compressed image. 

34. (Original) The apparatus as set forth in Claim 30, wherein the image sensing means 
is adapted to output an image signal in which a frequency-modulated color signal is superposed 
on a brightness signal, the apparatus further comprising means for separating the image signal 
into the brightness and color signals; 

the signal synthesizing means synthesizing the brightness signal and color signal 
separated by the signal separating mean to produce a synthetic brightness signal and a synthetic 
color signal, respectively; 

the image compressing means compressing the synthetic brightness and color signals to 
produce a compressed brightness signal and a compressed color signal, respectively; and 
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the level compensating means compensating the compressed brightness and color signals 
to produce a compensated compressed brightness signal and a compensated compressed color 
signal, respectively. 

35. (Original) The apparatus as set forth in Claim 34, wherein the level compensating 
means calculates a compensation amount based on the compressed brightness signal separated by 
the signal separating means, compensates the level of the compressed brightness signal with the 
compensation amount to produce a compensated compressed brightness signal, and produces the 
compensated compressed color signal based on the compensated compressed brightness signal. 

36. (Original) The apparatus as set forth in Claim 34, further comprising means for 
mixing the compensated compressed brightness and color signals. 

37. (Original) An image processing method of synthesizing a plurality of input images 
acquired by sensing an object under different exposure conditions to produce a single image 
excellent in gradation reproducibility, the method comprising the steps of: 

receiving a plurality of images acquired by sensing an object under different exposure 
conditions and compensating the levels of the plurality of input images on the basis of the 
exposure conditions under which they have been sensed respectively, to provide a plurality of 
compensated images; 

synthesizing the plurality of compensated images to produce a single synthetic image 
having a wide dynamic range; and 
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compressing the synthetic image to an extent depending upon the performance of its 
output destination to produce a compressed image. 

38. (Original) The method as set forth in Claim 37, further comprising the step of 
subtracting from the pixel level of each of the plurality of input images a positive value given 
based on the exposure condition under which each of the images has been sensed to produce the 
compensated image. 

39. (Original) The method as set forth in Claim 38, further comprising the steps of: 
calculating a mean pixel value of each of the plurality of input images; and 
multiplying the mean pixel value obtained at the mean calculating step by a factor set 

based on the exposure condition to calculate a positive value. 

40. (Original) The method as set forth in Claim 39, further comprising the steps of: 
time-smoothing the positive value obtained at the multiplying step; and 

subtracting the time-smoothed positive value from the pixel level of each of the plurality 
of input images. 

41. (Original) The method as set forth in Claim 39, wherein the factor is set larger for the 
input image having been sensed with a larger exposure at the image sensing step. 
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42. (Original) The method as set forth in Claim 38, further comprising the steps of: 
filtering the signal of each of the plurality of input images by a predetermined low-pass 

filter, and 

multiplying an output obtained at the filtering step by a factor set based on the exposure 
condition under which the image has been sensed to calculate a positive value. 

43. (Original) The method as set forth in Claim 42, further comprising the steps of: 
time-smoothing the positive value obtained at the multiplying step; and 

subtracting, at the subtracting step, the positive value obtained at the time-smoothing step 
from the pixel level of each of the plurality of input images. 

44. (Original) The method as set forth in Claim 42, wherein the factor is set larger for the 
input image having been sensed with a larger exposure at the image sensing step. 

45. (Original) The method as set forth in Claim 37, wherein each of the plurality of input 
images acquired at the image sensing step is an image signal in which a frequency modulated 
color signal is superposed on a brightness signal, the method further comprising the step of 
separating the image signal into the brightness and color signals; and 

the brightness signal and color signal separated at the signal separating step being 
compensated at the level compensating step to produce a compensated brightness signal and a 
compensated color signal, respectively; 

the compensated brightness and color signals being synthesized at the image synthesizing 
step to produce a synthetic brightness signal and a synthetic color signal, respectively; and 
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the synthetic brightness and color signals being compressed at the image compressing 
step to produce a compressed brightness signal and a compressed color signal, respectively. 

46. (Original) The method as set forth in Claim 45, wherein at the level compensating 

step: 

a compensation amount is calculated based on the brightness signal separated at the 
signal separating step; 

the level of the brightness signal is compensated with the compensation amount to 
produce a compensated brightness signal; and 

the compensated color signal is produced based on the compensated brightness signal. 

47. (Original) The method as set forth in Claim 45, further comprising the step of mixing 
the compressed brightness and color signals. 

48. (Original) An image processing method of synthesizing a plurality of input images 
acquired by sensing an object under different exposure conditions to produce a single image 
excellent in gradation reproducibility, the method comprising the steps of: 

receiving a plurality of images acquired by sensing an object under different exposure 
conditions and synthesizing the plurality of input images to produce a single synthetic image 
having a wide dynamic range; 

compressing the dynamic range of the synthetic image to an extent depending upon the 
performance of its output destination to produce a compressed image; and 
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compensating the level of the compressed image to provide a compensated compressed 



49. (Original) The method as set forth in Claim 48, further comprising the step of 
subtracting a predetermined positive value from each pixel level of the compressed image to 
produce the compensated compressed image. 

50. (Original) The method as set forth in Claim 49, further comprising the steps of: 
filtering the signal of the compressed image by a predetermined low-pass filter; 
normalizing an output value obtained at the signal filtering step; and 

multiplying the output obtained at the normalizing step by a predetermined factor to 
calculate a positive value. 

51. (Original) The method as set forth in Claim 50, further comprising the steps of: 
time-smoothing the positive value obtained at the multiplying step; and 

subtracting, at the subtracting step, the time-smoothed positive value from each pixel 
level of the compressed image. 

52. (Original) The method as set forth in Claim 48, wherein each of the plurality of input 
images acquired at the image sensing step is an image signal in which a frequency-modulated 
color signal is superposed on a brightness signal, the method further comprising the step of 
separating the image signal into the brightness and color signals, and 



image. 
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the brightness signal and color signal separated at the signal separating step being 
synthesized respectively at the image synthesizing step to produce a synthetic brightness signal 
and a synthetic color signal, respectively; 

the synthetic brightness and color signals being compressed respectively at the image 
compressing step to produce a compressed brightness signal and a compressed color signal, 
-respectively; and 

the compressed brightness and color signals being compensated at the level compensating 
step to produce a compensated compressed brightness signal and a compensated compressed 
color signal, respectively. 

53. (Original) The method as set forth in Claim 52, wherein at the level compensating 

step: 

a compensation amount is calculated based on the compressed brightness signal separated 
at the signal separating step; 

the level of the compressed brightness signal is compensated with the compensation 
amount to produce a compensated compressed brightness signal; and 

the compensated compressed color signal is produced based on the compensated 
brightness signal. 

54. (Original) The method as set forth in Claim 52, further comprising the step of mixing 
the compensated compressed brightness and color signals. 
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55. (Original) An image processing apparatus adapted to produce a single image 
excellent in gradation reproducibility from a plurality of input images acquired by sensing an 
object under different exposure conditions, the apparatus comprising: 

means for receiving a plurality of input images acquired by sensing an object under 
different exposure conditions and compensating the levels of the plurality of input images on the 
basis of the exposure conditions under which they have been sensed respectively, to provide a 
plurality of compensated images; 

means for synthesizing the plurality of compensated images to produce a single synthetic 
image having a wide dynamic range; and 

means for compressing the synthetic image to an extent depending upon the performance 
of its output destination to produce a compressed image. 

56. (Original) The apparatus as set forth in Claim 55, wherein the level compensating 
means comprises means for subtracting from the pixel level of each of the plurality of input 
images a positive value given based on the exposure condition under which each of the input 
images has been sensed to produce the compensated image. 

57. (Original) The apparatus as set forth in Claim 56, wherein the level compensating 
means comprises: 

means for calculating a mean pixel value of each of the plurality of input images, and 
means for multiplying the mean pixel value provided by the mean calculating means by a 
factor set based on the exposure condition to calculate a positive value. 
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58. (Original) The apparatus as set forth in Claim 57, wherein the level compensating 
means comprises: 

means for time-smoothing the positive value provided by the multiplying means; and 
means for subtracting the time-smoothed positive value from the pixel level of each of 
the plurality of input images. 

59. (Original) The method as set forth in Claim 57, wherein the factor is set larger for the 
input image having been sensed with a larger exposure by the image sensing means. 

60. (Original) The apparatus as set forth in Claim 56, wherein the level compensating 
means comprises: 

means for filtering the signal of each of the plurality of input images by a predetermined 
low-pass filter; and 

means for multiplying an output of the signal filtering means by a factor set based on the 
exposure condition under which the image has been sensed to calculate a positive value. 

61. (Original) The apparatus as set forth in Claim 60, wherein the level compensating 
means comprises means for time-smoothing the positive value provided by the multiplying 
means; 

the subtracting means subtracting the time-smoothed positive value from the pixel level 
of each of the plurality of input images. 

62. (Original) The apparatus as set forth in Claim 60, wherein the factor is set larger for 
the input image having been sensed with a larger exposure by the image sensing means. 
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63. (Original) The apparatus as set forth in Claim 55, wherein the image sensing means 
is adapted to output an image signal in which a frequency-modulated color signal is superposed 
on a brightness signal, the apparatus further comprising means for separating the image signal 
into the brightness and color signals; and 

the level compensating means compensating the brightness signal and color signal 
separated by the signal separating means to produce a compensated brightness signal and a 



the signal synthesizing means synthesizing the compensated brightness and color signals 
to produce a synthetic brightness signal and a synthetic color signal, respectively; and 

the image compressing means the synthetic brightness and color signals to produce a 
compressed brightness signal and a compressed color signal, respectively. 

64. (Original) The apparatus as set forth in Claim 63, wherein at the level compensating 
means calculates a compensation amount based on the brightness signal separated by the signal 
separating means, compensates the level of the brightness with the compensation amount to 
produce a compensated brightness signal, and produces the compensated color signal based on 
the compensated brightness signal. 

65. (Original) The method as set forth in Claim 63, further comprising means for mixing 
the compressed brightness and color signals. 




compensated color signal, respectively; 
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66. (Original) An image processing apparatus adapted to synthesize a plurality of input 
images acquired by sensing an object under different exposure conditions to produce a single 
image excellent in gradation reproducibility, the apparatus comprising: 

means for receiving a plurality of images acquired by sensing an object under different 
exposure conditions and synthesizing the plurality of input images to produce a single synthetic 
image having a wide dynamic range; 

means for compressing the dynamic range of the synthetic image to an extent depending 
upon the performance of its output destination to produce a compressed image; and 

means for compensating the level of the compressed image to provide a compensated 
compressed image. 

67. (Original) The apparatus as set forth in Claim 66, wherein the level compensating 
means comprises means for subtracting a predetermined positive value from each pixel level of 
the compressed image to produce the compensated compressed image. 

68. (Currently Amended) The apparatus as set forth in Claim 67, wherein the level 
compensating means comprises: 

means for filtering the signal of the compressed image: 

means for normalizing an output value provided by the signal filtering means; and 

mans means for multiplying the normalized output by a predetermined factor to 
calculate a positive value. 
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69. (Original) The apparatus as set forth in Claim 68, wherein the level compensating 
means comprises. 

means for time-smoothing the positive value provided by the multiplying means; and 
means for subtracting the time-smoothed positive value from each pixel level of the 

* 

compressed image. 

70. (Original) The apparatus as set forth in Claim 66, further consisting means for 
separating the image signal into the brightness and color signals; 

the signal synthesizing means synthesizing the brightness signal and color signal 
separated by the signal separating mean to produce a synthetic brightness signal and a synthetic 
color signal, respectively; 

the image compressing means compressing the synthetic brightness and color signals to 
produce a compressed brightness signal and a compressed color signal, respectively; and 

the level compensating means compensating the compressed brightness and color signals 
to produce a compensated compressed brightness signal and a compensated compressed color 
signal, respectively. 

71. (Original) The apparatus as set forth in Claim 70, wherein the level compensating 
means calculates a compensation amount based on the compressed brightness signal separated by 
the signal separating means, compensates the level of the compressed brightness signal with the 
compensation amount to produce a compensated compressed brightness signal, and produces the 
compensated compressed color signal based on the compensated compressed brightness signal. 
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72. (Original) The apparatus as set forth in Claim 70, further comprising means for 
mixing the compensated compressed brightness and color signals. 

73. (New) An image pickup apparatus adapted to synthesize a plurality of images 
acquired by sensing an object under different exposure conditions to produce a single image 
excellent in gradation and reproducibility, the apparatus comprising: 




means for sensing an object under different exposure conditions to acquire a plurality of 
images; 



means for synthesizing plural images to produce a single synthetic image having a wide 
dynamic range; 

means for compressing either the synthetic image or the dynamic range of the synthetic 
image to an extent depending upon the performance of its output destination to produce a 
compressed image; and 

means for compensating the level of images supplied thereto to provide compensated 
images, whereby said compensating means is supplied with either (a) the images acquired by 
said sensing means to compensate the levels of said images on the basis of the exposure 
conditions under which said images have been sensed, respectively, and said synthesizing means 
is supplied with the provided compensated images, or (b) the compressed image and said 
synthesizing means is supplied with the acquired uncompensated images. 
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